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BOUNDS FOR THE EIGENVALUES OF A MATRIX* 

By Kenneth R. Garren 
Langley Research Center 

SUMMARY 

This paper provides a listing of techniques used to determine the eigenvalue bounds 
of a matrix defined over either the real or complex fields. Theorems concerning the 
condition of eigenvalues as a function of the related matrix are stated. Known theorems 
which determine the bounds are derived. Closed-form solutions are expressed in terms 
of (1) the matrix elements, (2) matrix norms, and (3) vectors and the eigenvalues of 
related matrices. Extensions of several results are made to infinite matrices. A com- 
parison is made in terms of the relative size of the areas of eigenvalue inclusion for the 
various solutions. Examples in terms of eigenvalue bounds for particular matrices are 
given. 


INTRODUCTION 

In various applications of operator theory, it is often required to determine the 
spectrum a(A) of an operator A, that is, all scalars X for which A - X has no 
inverse. For the n-dimensional operator, this problem is to determine those scalars X 
for which there exists an associated nonzero vector x such that Ax = Xx. Solutions in 
this case can be assumed by requiring the vanishing of the determinant of the associated 
operator A - XI n for the n-dimensional identity matrix I n . Expansion of this determi- 
nant yields an nth degree polynomial, the roots of which are the eigenvalues of the 
matrix A. The roots of the general polynomial of degree n can be determined directly 
(that is, solvable by radicals (ref. 1)) if and only if n ^ 4. However, various techniques 
do exist for determining upper and lower bounds for eigenvalues and very often this 
information is sufficient to solve various types of problems. 

This paper is concerned with listing known techniques which determine eigenvalue 
bounds and with comparing their relative accuracies. These bounds are expressed in 
terms of (1) the elements of the matrix itself, (2) matrix norms, and (3) vectors and 


*Part of the information presented herein was offered as a thesis in partial ful- 
fillment of the requirements for the degree of Master of Arts in Mathematics, College of 
William and Mary, Williamsburg, Virginia, 1965. 




eigenvalues of related matrices. Extensions of several results are made to infinite 
matrices. 


SYMBOLS 


a,g,j,k,m,n,r,s > £l real numbers 
M,N;o^/3,y,6,e,aJ 


a ij>§ij>tij,bkk elements of a matrix, occupying ith or kth column and jth or kth row 

|| A |j matrix norm of A 


A ij»A,B,B e ,Gl 
H,T,U,D J 


matrices defined over complex field 




sup || A ijx||j> 
equal to xcfii 
x^O 

vector norm evaluated in subspace % 



diag(aj,...,a n ) diagonal matrix with a^, 



X=0 


kth derivative evaluated at X = 0 


., a n down the main diagonal 


In 

Ji 

*1 

P 

P 


Pk 


column vector, all of whose components are 1 
element for which its square is equal to -1 
identity matrix of order n 
ith Jordan block corresponding to X^ 

set of all vectors x = xj, X£, . . . for which it is true that 

polynomial 

permutation matrix 

n 

numerically equal to 

i 

j*k 



OO 


In 

i=l 


< CO 


2 


q(x) = 


( x > A x) 

(x,x) 


11*11 




X,h,x,y,z,y 


or Rayleigh* s quotient 
vector norm evaluated in subspace 
vectors 


Xp x i, x j,yi,yA 

z i’ z j> z ii J 


components of vectors or vectors themselves 


e 

X 

X A 

A 

a(A) 

M ]- 1 

n 

det 

inf 

max 

min 

sup 

I I 

II II 


error 

eigenvalue 

eigenvalue of matrix A 

Jordan canonical or normal form of matrix 

spectrum of A; i.e., the set of all complex numbers X for which 
A - X has no inverse 

set whose elements are inverse of elements of cr(A) 

equal to det (A - XI) 

subspace 

determinant 

infimum or greatest lower bound 
maximum value 
minimum value 

supremum or least upper bound 
modulus or absolute value 
equal to < , for a vector 
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complex scalar product 


< , > 

e belongs to a set 

Subscripts: 

i,j,k,Z,n integers 

max maximum 

min minimum 

Superscripts: 

A,B,B e ,H matrices 

T matrix transpose 

oijk real numbers 

* conjugate transpose 

- complex conjugate 

WELL-KNOWN THEOREMS FOR EIGENVALUES 

Some well-known results concerning the eigenvalues of particular types of matrices 
are given in table I. Other results which are less well known than those in table I, but yet 
of some importance are: 

(1) If A is a positive real matrix, that is, a^j > 0, then there exists a real, posi- 
tive eigenvalue which is simple and such that its absolute value is greater than that of 
any other eigenvalue. (See ref. 8.) 

(2) If A is a nonnegative irreducible real matrix, that is, a^j = 0, then there exists 
a real positive eigenvalue. (See ref. 9.) 

(3) If there exists a k such that A^ is a positive real matrix, then there exists 
an eigenvalue of A such that it is real, and its absolute value is greater than any other 
eigenvalue. If, in addition, k is an odd integer, then this eigenvalue is positive. (See 
ref. 10.) 


4 



TABLE I.- EIGENVALUE THEOREMS 


Condition of A 
Nonzero operator 


A - * exists 
Hermitian 
Real symmetric 
Skew hermitian 
Real skew symmetric 
Isometry 
Orthogonal 
Triangular, that is, 

a n 0 • • • 0 

a 21 a 22 • ‘ ' 0 


A = 


[fill a n2 a nn 

or 

A T 

Permutation, that is, 

0 1 0 ... 0 0 
0 0 1 ... 0 0 


0 0 0 ... 0 1 

1 0 0 ... 0 0 


Notation 

Condition of X 

References 

A 

cr(A) is a nonempty, closed, 
and bounded subset of 
complex numbers 

2 

A = A* 

o(p(A)) = p(a(A)) where p is 
a polynomial 

a(A _1 ) = |a(A)| 

All X are real 

3 

3 

4, 5, 6 

ii 

< 

All X are real 

4, 5 

A = -A* 

All X are imaginary 

4 

1 

II 

<c 

All X are imaginary 

4 

A*A = I 

N = 1 

4, 6 

A T A = I 

N = 1 

4 


x i * a jj 

5 

A = P 

x i = cos (¥) + isin (^ i ) 

7 


for j = 0, 1, . . ., n - 1 




THEOREMS FOR EIGENVALUE BOUNDS 


The bounds for eigenvalues may be determined by various techniques. In general, 
these techniques express the bounds in terms of (1) the elements of the matrix itself, 

(2) matrix norms, and (3) vectors and eigenvalues of related matrices. Although the 
eigenvalues may be approximated by considering the roots of the characteristic equations, 
the necessary procedures (Newton’s method, Graffe's method, etc.) require a "first 
guess" of the roots combined with successive iterations. These relations do not lend 
themselves to closed-form solutions of eigenvalue limits. In this paper, only those types 
of relations listed are investigated. 


A.- Bounds by Matrix Elements 

An important relationship giving the eigenvalue bounds in terms of the matrix ele- 
ments and matrix order is provided by the following theorem. (See ref. 11.) 

Theorem Al .- Let A be a complex matrix of order n. Define 

G = |(A + A*) 

T = |(A - A*) 

Let 

a = maxjajjj 
g = max|g i; j| 
t = maxjt^j j 
X = a + i/3 

Then 

| X | t na 
| a| = ng 


1 0 1 = nt 

Proof: Let Ax = Xx so that 


and 

or 


<x,Ax> = <x,Xx> = X<x,x> 
<Ax,x> = <Xx,x> 
<x,A*x> = X<x,x> 
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I 


Then 

or 


Likewise 


or 


<x,Ax> + <x,A*x> = (a + i|3)<x,x> + (a - i0)<x,x> 

<x,(A + A*)x> = 2of<x,x> 

<x,Gx> = a<x,x> 

<x,Ax> - <x,A*x> = 2ij3<x,x> 

<x,Tx> = i/3<x,x> 

-i<x,Tx> = j3<x,x> 


By the Cauchy- Schwarz inequality, 


n n 


n n 


| X<x,x >| = |x||<x,x>| = |<x,Ax>| ^ Y ^ | a ij|| x i|| x j| = a ( J 7 | x i|| x j 

^ ^ \i=l j=l 


n n 


i=l 3=1 
n n 


n n 


s t 2 2(i x ‘i 2+ i x ii 2 )-i 2 2hi 2+ tl 2 i x ji 

i=lj=l V ' i=l j=l i=l j=l 


na na 
2 2 


= na 


where the x terms are normalized so that <x,x> = 1. Thus |\|§na. Proceeding in 
a similar manner since 


yields 


ot<x,x> = <x,Gx> 
| a | S ng 


Likewise, since /3<x,x>= -i<x,Tx>, 

| /3 | g nt 

Bendixson (ref. 11) found a bound for the imaginary part for a real matrix A. 
Theorem A2.- Let A be a real matrix of order n, 


Then 


T = |(A - A t ) 
A = a + i/3 


101 st 


V n ( n - 1) 

2 


7 


I 


Proof: Since Ax = Ax for x = y + iz, 

A(y + iz) = (a + i/3)(y + iz) = (ay - /3z) + i(az + /3y) 
Equating real and imaginary parts yields 

Ay = ay - /3z 
Az = az + /3y 

so that 

<y,Az> = <y,az> + <y,/3y> 

-<z,Ay> = -<z,ay> + >z,/3z> 

and by adding 

<y,Az> - <z,Ay> = /3(<y,y> + <z,z>) 

Now 


<y,Az> - <z,Ay> = <y,Az> - <A*z,y> = <y,Az> - <y,A T z > = <y,(A - A T )z> 
= |3(<y,y> + <z,z>) = 0(1 y| 2 + |z| 2 ) 


or by definition of T, 

0(<y,y> 

Therefore 

J3 (, ,5 


2V y l 

Since T = -T T , tjj = -t^ 

and t^ = ( 


n n 


n n 


<y ’ Tz> - I I Wj - 2 2 ' y i z i) 

i=l j=l i=l j=i+l 


n n 


2 

i=l j=i+l 


n n 


! ‘ y i| - ( 2 2 l y ‘ z i ‘ z i y il 

i=l j=i+l 


where t = max tjj and squaring the preceding equation yields 


n n 


^ 2 (l|y|| 2 + l( z l| 2 ) = 4t2 ( £ J l y i z i " Ziy i 

\i=l j=i+l 


( 1 ) 
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where ||y|| =<y,y>. By the arithmetic- geometric mean inequality, for real num- 
bers rj, 


( r i 


+ . . . + r 


mf = m ( 


r l + • • • + r mJ 


There are n^ elements in the matrix; the diagonals do not appear in this sum since 
tii = 0. For every two elements of the matrix, one combination is used in the summa- 
tion. Thus, there are n ~ — or n ^ n - ~ ~— combinations. Thus by the arithmetic- 

Ci Ci 

geometric mean inequality, 

(Hh - z ‘ y j|) sS!S f ii I I l y i z i ■ z ‘ y i | 2 

' ' i=l j=i+l 

Consider now 


(|y | 2 + |z| 2 ) -(|y | 2 - l z | 2 ) = 4 M 2 | 


By Lagrange's identity, 


n n 


y| 2 l z l 2 = <y, z>2+ 1 Z ( y i z i ‘ z i y i) 2 

i=l j=i+l 


Thus 


n n 


(|y| 2 + |z| 2 ) 84^2 ( y i z i - z i y j) 
i=l i=i+l ' 


r- 

Substituting this result into equation (1) yields 


n n 


n n 


w 2 2 2 (yi z j - z i y j) 2 ^ /3 2 (| y| 2 +1 z l 2 ) = 4t2 (J 2 l y i z r z i y j| 

i=l j=i+l \i=l j=i+l 


n n 


< 4t2p^il £ 2 |yi z j - yfif 

J i=l j=i+l 


Thus |5 2 S t 2 

The importance of these two theorems lies in their ability to determine an upper 
bound for the real and imaginary components separately. However, the following theorem 
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proven by L£vy-Hadamard-Gerschgorin (ref. 12) gives an even more basic result and 
has since been used as a cornerstone for many more theorems of eigenvalue bounds. 

Theorem A3 .- Every eigenvalue of a matrix is contained in at least one of the n 
disks whose centers are ajj and whose radii are 



(i = 1, . . n) 


Proof: Let B be a matrix of order n. The system of equations Bx = 0 has a 
nontrivial solution if and only if det B = 0. Let x^ be the dominant component of 
x = (xp . . ., x n ^, that is, |x k js| Xi | for all i. Then, the kth equation is 


or 


n 


b kk x k = 


-I 

m=l 

m^k 


b km x m 


b kk x k 


n n 

| S 1 | b km|| x m| s | x k| £ | b km| 


m=l 

m*k 


m*k 


and thus 


n 

b kk| g X | b kmJ 

m=l 

m^k 


Let B = A - XI, where X is such that det(A - XI) = 0, the "eigenvalue problem." 
Therefore 


| X ' a kk| = X | a kmj 
m=l 
m^k 

This theorem can be generalized to countably infinite dimensional operators which have 
a summable matrix representation; that is, 

1 In*- 

j=l i=l 
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Corollary A3: If A is a summable matrix whose eigenvectors x = ^Xj,Xg, . . . 
are in l j and x = ^x-^Xg, . . is in l ^ means that 

00 

1 N < ” 

i=l 

the results of theorem A3 hold. 


Proof: For all eigenvectors x 

ponent, say x k of x, for which x k 
all iV The kth equation is then 


of A, x in implies that there exists a com- 
is a dominant component /that is, |x k | = jx^l for 


b kk x k = 


ou 

■I 

m=l 

m^k 


b km x m 


where = a^ for i * j and b^ = a^ - X so that, as before, 
Thus all eigenvalues are bounded by 




m*k 



< °°. 


OO OO oo 

x ■ ®kk| = I | a km| <11 N < 

m=l i=l j=l 

m^k 


Theorem A4 .~ The following theorem is of interest with respect to the preceding 
corollary. For a summable matrix, an eigenvector is in l ^ if and only if it has a 
finite dominant component. 

Proof: From Ax = Xx, 


so that 


00 

1 


i=i 


= x Xi 


(i = 1, 2, . . .) 


Therefore 


OO OO 


x l In- X I a i« f I Inn 

i=l i=l j=l i=l j=l 


OO OO 


L x 3i=[x] 1 lMbi= x I In 

j=l ' i=l j=l i=lj=l 


< <» 


11 


if is a dominant component and X =£ 0. 


Thus, 


CO 


In 

1 = 1 


< °o 


and x e ly 


Clearly, for x e ly x has a dominant component 

Corollary A4 (Frobenius): An almost immediate consequence of theorem 4 is the 
well-known "Theorem of Frobenius." 

n 

Nmax = max I l^l 
m=l 


X I . = min 

'min 


/, 


n 


| a kk| " X | a km| 


V 


m=l 

k=£m 


Proof: 


| X ' =I X I " I 3 !*! 

so that from the preceding inequalities 


Also 


so that 


X i a 


kk 


IX 

^ | ^km 


m=l 

m^k 


n 


I 

m=l 



X - a kk| = 1^1 " l X l 


X g a, 


Also, since det A = det A^, 


kk 


11 

Ij' 

m=l 

m^k 


km 


n 

X | akm | 


m=l 

m^k 


may be replaced in theorem A3 and its corollary A3 by 



m=l 

m*k 
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Thus, the centers of the circles containing the eigenvalues will remain unchanged even 
though their radii will be changed. 


Theorem A5 .- As a further refinement of corollary A3, Alfred Brauer (ref. 13) 
was able to restrict the regions containing the eigenvalues by means of the "ovals of 
Cassini" in this theorem. Each eigenvalue of A 
ovals of Cassini 


lies in at least one of the n ^ n ~ 

2 




J*k / \i*k 


and in at least one of the ovals 


/ n \ / n ' 

| X " a kk| | X " hl\ = f Z | a ik|] f Z l^il 


Proof: For x = ^Xj, Xg, . . . x n ^ 


i=i y v 3=1 

i^k / \ j# 


n 


(X - a^xi = ^ a ijXj 


j=l 


Let x k S x^ £ xj for j * k, j * l. Then 


and 


n / n 

| X_ “kkIM = £ | a kj|| x j| =[ Z l^jll n 
i=i \ j=i 

i^k \j*k 


\ x -*ii\\*i\= Ihiii x 3|= In\)n 

j=i \ i=i 


(i = 1, 2, . . ., n) 


Therefore 


so that 


x " a kk| \ x ~ *ii\ = ( J, l^ilV J, hil 


V 


j=l 

j*k 


which proves the theorem. 


Similarly, it may be shown that all eigenvalues of A are contained in at least one 
of the ovals 


X - 


/ n \ / n ' 

a kk| ” a £z| s J| a ik| | J| a ik| 


There are n elements ajj which, in part, form the ovals. The number of distinct sub- 
sets with two elements that can be chosen from this set of n elements is 


n! _ n(n - l)(n - 2)1 _ n(n - 1) 

2! (n - 2)! 2(n-2)I " 2 

Thus, there are n ^ n ~ ^ ovals. 

’ 2 

Theorem A6 .~ Another inequality (ref. 14) giving the regions in which the eigen- 
values are contained is presented in the following theorem. For the matrix A = , 


/ ^ v °j '■/ ^ ^ 




k=l 

, k*i 


for 0 = a = 1. 


Proof: As was shown in theorem A3 and corollary A3, for the determinant of 
A - XI to vanish, the following inequalities must be satisfied: 

n 

"“I = XNl 

j=l 

n 


X - a< 


| X " M “ Z | a ki 


k=l 

i^k 


14 


I 



Thus, 


M " ( \ X “ ®ii| )(l X " aii l )=fZ l® 1 !^ f 2 1^1 


1 1-a? 


3 =1 


k=l 

t i*k 


whenever Oiail. 

Corollary A6(a): Two simple corollaries to this theorem are presented, 


X A < 
max ~ 


a . 


n 


1-a 


m + In I n 

i=l J\ k=l 

i^i / \i#k 


a a > 
min ~ 


a/ xv \ 1-a 


M Z M ) ( Z M 

j=l 11 k=l 
\i*k 


] 

J* 1 


max 


a ii + 




In 

3=1 

H 


a 


n 

N + 1 M 


k=l 

i^k 


1-Q! 


1 min 


n 


101 


®ii| Z I !]| 

3=1 

j*i 


n 


>u| + 1 M 


k=l 

i*k 


1— Of 


All for 0 I a s 1, The corollaries and theorem hold likewise for a = 1 - j3, 1 

where 0 = (3 = 1. 

Corollary A6(b): Corollary A6(b) is a direct consequence of theorem A5. 

each a, 0 S a ^ 1, every eigenvalue of A lies in at least one of the n ( n ~ D - 



For a = 0 or a = 1, this relation reduces to theorem A5. 


- a = /3 

For 

ovals, 
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Theorem A7.- As a further extension of theorem A5, the largest eigenvalue may be 
bounded from the results of reference 13. Each eigenvalue X satisfies 


where 


X 


5 - max 
2 k,j=l,2,.. 
k*j 



+ 


*11 1 + 


(h*l 



+ 4P fc Pj 



= M 


1=1 

j^k 


Proof: Assume that |a rr | = |a ss 
(1) If | X | ^ I a rr j , then 



< 



+ 




1 / 2 " 


4P P 
r^ s 


^ M 


since 

P r IO 

P s = ° 

(2) If jxj > |a rr | ^ |a ss |, then 

0 < | X | - | a rr | = j X - a rr | 

0 < | X| - | a ss | = |X - a ss | 

From the corollary A6(b), 

^ I X | - |a rr |^|x| - ja ss | j ^ |x - a rr | |x - a ss | S P r P s 
or 

| X|^ - ^|a rr | + |a ss |j| X| + |a rr a ss | - P r P s = 0 
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1 


and 



Part (1) 




■§ 


a rr| + | a ss| " \|( | a rr " a ss|) + 4P r P s 


= 0 


Part (2) 

Thus, either Part (1) S 0 and Part (2) SO or Part (1) S 0 and Part (2) £ o. How- 
ever, since 


Part (1) = | X| + 


l a rr a ss 


\j([ a rr| " | a ss|) + 


4P r P s 


S|X| 


rr “ss 


-|a„j - |a OC3 | +w^ja rr | -|a ss Q + 4P r P s 


= Part (2) 


then it must be true that Part (1) § 0 S Part (2). Thus from part (1), it follows that 



In addition, if a third condition is satisfied, namely, 

| a kk a jj| >P k P j 

then a similar type of lower bound for the modulus of the eigenvalues of A can be 
formulated (ref. 13). 

Theorem A8.- If 



> P k P i 


(k, j — 1, 2, . . ., n) 
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then 


N * + M ' [(1^1 ‘ Mf + 4P ^]/ 


= m > 0 


Proof: As was shown in the proof of theorem A7 


*1-1' 


a rr + i a ss| 


a rr " a ssj j + ^Pr^s 


g 0 


or 


A 


a rr j + | a ss| “ a rr “ j a ss j + 


Assume that m is attained where k = y, j = 6, so that 


r , , , 

/ . . . 1 \ 2 

1/2 | 

(| a yy| + j a 66j ' 

(|v|-M) +4P ^ 

J 


a yy + J a 6 6 1 " ( | a yy ” ^| a yy a 66| + a 66 + ^^y^S 


1/2 


IVk) + | a 66| " ^ | a yy| " 2 | a yy a 66| + | a 66j +4 | a yy a 65jj 


1/2 


f , , 

/, , \2~ 

1/2) 

\| a yy| + | a 5 6 1 

(|V| + | a 6«|) 

J 


= o 


Note that all the previous theorems have given bounds only for the modulus of the 
eigenvalues. However, for a particular case, more definite information may be implied 
from exact information regarding the values of the elementary symmetric functions of 
Xj, X2, . . ., A n . Several important results concerning these functions are given by the 
following theorem. 

Theorem A9 .~ For an arbitrary matrix 

n 

i=l 
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and 


n 

n 

i=l 


n Xj = det A 


n n 


i=l j=l 


if A is real. 

Proof: Let 


i J/(A) = det(A - XI) 


k- 1 

By a Maclaurin's series expansion of the coefficient of X is 


d k 'V(X) 


(dX) 


k-1 


— (k - 1)! /a^ j + . , 

• + a nnj 

X=0 



Also by the fundamental theorem of algebra, 

*(X) = (xi - x)(x 2 - x) . . . (x n - x) 

where the Xj, . . X n are the eigenvalues of A. Then 


d k ~ 1 »//(X) 
(dX) k_ 1 


x=o 


= (k- i):(x 1 + 



Thus 


Also for xp = det (A - XI) 


and for 


n 

^(x) = n Xi - x 

i=l 


n 




s Trace of 


A 


<M0) = 


d°^(X) 

(dX)° 


x=o 


= det A 


xjy(0)= n 

i=l 
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Thus II X j = det A. Likewise, the other elementary symmetric functions are the corre- 
sponding coefficients of the characteristic equation. 

k k 

Since the multiplicity of Xj in A is the same as the multiplicity of A^ in A , 

then 

n 

Trace of A k = ^ A k 

i=l 

(Note, if all A = 0, then \f/( A) = A n = det(A - AI) = det A = 0.) Let k = 2 so that 


Also 


Trace A 2 = A? + . . . + A*? 

1 n 


Trace A 2 = £ a 2 + £% Vh* 

i=l i=l k=l 

i^k 

TraceA T A = f I4i’l 4* l 14 


2 

ik 


k=l i=l i=l k=l i=l 

k#i 


Since af k + ^ Sa^, then 


2 T 

Trace A ^ Trace A A 


Thus 


n n n 

It'll l 


k=l 


i=l k=l 


B.- Bounds by Matrix Norms 

In this section, the eigenvalue bounds, are determined in terms of matrix norms. A 
matrix norm ||A|J of a square matrix A is any bounded real-valued function for which 
the following matrix norm properties are true: 


(1) 

A >0 

whenever A * 0 

(2) 

8 

_> 

11 

a . | jjA|[ where a is a scalar 

(3) 

||A ♦ B|| 

1IA 

+ 

td 

(4) 

I|AB»S| 

A B 
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^Property (3) implies that the norm is a continuous function of A; that is, 

|II A II " || A n|j| for any e, whenever ||A - A n || is sufficiently small.) 

The following is a listing of several possible norms for an arbitrary matrix 

A = ( a ij)n : 

ll A ll E = VTrace (A* A) = Square root of sum of squares of A (Euclidean) 

[ | A| | e = Maximal row (column) sum of (|ajj|) n 
||A|| T = Maximal row (column) sum of (| a ij|) n 

l|A||g“H G ' 1 AG|l e 

where 

G any nonsingular matrix 

1 1 A| | any matrix norm 


Ge = g 





n 

IIaIIs- £ |aij| 
i,i=l 

||a||j = |^inax^ ||Ax)| which is the induced norm 

A relation between the eigenvalue bounds and the value of powers of the matrix is given 
in reference 15. 

A 

Theorem Bl .- All eigenvalues X of the matrix A are contained within the unit 
circle if and only if 


lim A n = 0 
n— °° 
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Proof (1): Assume that all eigenvalues of A are contained within the unit circle. 
Then choose an arbitrary e > 0 so that 


1 ‘max 

It is now desirable to find a matrix norm with 

. A| 


+ e < 1 


A * 


'max 


+ e < 1 


for by property (4) of matrix norms, it follows that 


If ||a|| < 1, then 



lim |jA|| n = 0 

n— oo 


This relation implies that 

lim J| A n || = 0 

n— oo 

By the contrapositive of property (1) of matrix norms and norm continuity 

lim [|A n || = 0 
n— oo 


implies that 


lim A n = 0 

n— oo 


so that the sufficiency portion would be proven. 

A desired matrix actually does exist. Define || A ||g to be the maximal row sum of 
absolute values of G" *AG. 

Let A be the Jordan canonical or normal form of A so that A = T“*AT. Then 
A is an upper triangular matrix. Let P = diag(6“ n ,5* -n ,5^ -n ,...) where 5 > 0. Then 

|x i 60...(T 

0 Xi 6 ... 0 

0 0 Xi . . . 0 


P _1 AP = 


0 


0 


0 
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Thus j|p -1 Ap|| e S U A l max + € since the value of its maximal row sum may be made 

sufficiently close to U A l max by choosing 6 small enough. Transforming the e 
norm by P, that is, Pe = g, yields 


|A|l K -||p- 1 Ap|le S U A Lax + e<1 


Therefore, by defining the norm ||A|| = A * the sufficiency portion is proven 

5 


Proof (2): Let lim A n = 0. Now 
n— °° 


A n = (T _1 AT) =(t _1 At) 1 (t _1 At) 2 . . . (t"^At) = T _1 A n T 


Therefore, lim A n = 0 implies 

n— oo 


or 


Thus 


lim T -1 A n T = 0 
n— °° 


0 = T -1 /lim A n V 
In— °° 


lim A n = 0 
n — 00 


Then each element n a ij of the Jordan matrix A n must be such that 


lim 

n— °ol 


n a ij 


= 0 


for all i,j. 

Let A be partitioned into block diagonal form where each block corresponds to a 
distinct eigenvalue of A. That is, 


Jl 


A = 


0 


J2 


0 

J k 
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where 


Then 



where 



Thus, in particular, 

lim A? 1 = 0 
n— <=o 1 

so that | AjJ < 1 for all i. The importance of this relation is obvious when iterative 
(numerical) techniques defining the matrix A as the error in the approximate solution 
are considered. 
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Theorem B2 .~ One of the most significant and generalized results is given by the 

following theorem (ref. 15). For an arbitrary matrix A, the largest possible eigenvalue 

modulus is k A £ llAll for any matrix norm of A. 

1/1 'max " " 


Proof: Let ||A|| = ol, a real scalar. Also define Be 
positive. 


A 

(a+e) 


where e is 


Consider 


INI = 


(a+ e ) 




for all e > 0, that is, ||B e || < 1. By the proof of theorem B1 (proof (1)), ||b € || < 1 

implies that lim B|? = 0, which, by the result of theorem Bl, implies that for all eigen- 


n— °° 

B, 


B, 


values of B g , X^ e , it is true that X^ 6 <1. If X^ is any eigenvalue of A, there 


will exist a corresponding eigenvalue of B such that 

B, 


X A 

X J e - X i 
i a+e 


From this relation, since 


1 


< 1 for all eigenvalues of B e , then 
< 1 


\ A 


a+e 


or 


Therefore 


* 


* 


max 


< a + e = ||A|| + e 
= ) j A|j since the relation is true for all e > 0. By using this 


result, a more precise bound is established. (See ref. 2.) 
Theorem B3 .- 

_ n||!/n 

'max 


= lim 1 1 A' 

n— °° 


Proof: From previous theorems, 

,A n l 


'max 


A 


vn 


and 


Thus for all n 


XA“ , (xA)” 

S ||A”|| 1/n 


’max 


( 2 ) 
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so that 


max 


^ inf II A 
n 


nil 1 /” 


and thus 


'max 


g lim infllA 
n — 00 n 


nllVn 


B 


By theorem Bl, |X 


Bn || 1//n < Thus, 


•max 


< 1 implies lim||B n || = 0, so for all n > N, ||B n || < 1 and 
n— 


sup|[B n || 1/2 ^ 1 


n>N 


and 


lim sup||B n || ^ s 1 


n — 00 n 


Then for arbitrary A and e > 0, let C = (|A A | max + eV A so that |* c | max < 1 and 

lim sup|jc n Jj 1 


n— <=° n 


Therefore 


lim sup||A n || 1//n £ |a a J 


n — 00 n 


max 


( 3 ) 


Combining inequalities (2) and (3) yields 



< 

max ~ 


lim inf Ha 11 )} 1 ^ 11 ^ lim sup(jA n || 1 ' / ^ n < 
n— °o n n — 00 n 



max 


Theorem B4 .- If A is Hermitian, then HA^ = sup||A| : Ae cr(A) } . The proof of this 
theorem is given in reference 3. 

If the matrix is partitioned such that each diagonal submatrix is square, then 
eigenvalue bounds may be determined by procedures similar to those used in the sec- 
tion ”A.- Bounds by Matrix Elements.” 
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Let A be any matrix order n, which is partitioned as 


A = 


A 11 A 12 


a in 


a ni 


V NN 


where the diagonal submatrices A^ are square of order nj. Define the matrix norm 
by 


su p Ihilla 


Ai-j = xe:^ 

x*0 ll x llnj 

for an arbitrary vector norm over the subspace £2^. If the diagonal submatrices 
are nonsingular and if 


A jj ll) > Z ll A i k l| 


(1 = j = N) 


k=l 

k*j 


then the matrix A is said to be "block strictly diagonally dominant." (See ref. 16.) 
Theorem B5 .~ For every partitioning of the matrix A, each eigenvalue A A 


satisfies 


( A j,j ' XI i) X || = X ll A b k ll 


whenever the 


( A jj ■ ^j) 1 


k=l 

k*j 


exist. 


Proof: Assume that A - XI is singular. Then there exists a nonzero partitioned 


vector X = 


Xi 


v n 


such that 


(A - XI)X = 0 

Consider A - XI in its partitioned form; this relation implies 
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( 4 ) 


N 


2 AijXj = -(Au - XIi)3q 

i=i 

Let X r be the largest component of X, that is, 


INI s Pill 

Divide X by ||x r j|. Then from equation (4) 

N 


(1 = j = N) 


I A rpj 


j=l 

i^ r 


— (Arr - AI r )x r 


(5) 


From the Cauchy- Schwarz inequality, the left-hand side of equation (5) is such that 

n n 


(A rr - AIr)Xr|l = ^ |jA r j 

i=i 

j*r 


"j 


= Z N 

J=1 

j*r 


( 6 ) 


since 


1 = ||X r g ||Xi 


by the division of X. 

Let Zj*j* = ^Aj-j- — XI r jx r . Then 

||(A rr - Al r )x r || . IK Arr ' ^ 

since 


Z 


rr 


(Arr - XI r j Z rr | 


(Arr ~ ^r) 


-1 


(?) 


(A rr ■ 

- XI j 

■)" l X r 

. < cim L 

(Arr ' 

- 

r)' lx 1 


X r 

X 

|x|| 



= iifA rr - Ai r ) 


-li 


The first part of the inequality follows from the fact that 


Bx 


inf iii±LL inf 
x 


|| B_1 y|| 

11 


sup U 


B'Vll llBil 


J_= B-nr 1 
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From this equality and continuity of the norm, if B is singular, the definition 
||b - 1 || _1 = 0 is obtained. Then from equations (5), (6), and (7) 


( Arr ~ Ur ) l = Z I'M 


3=1 

j^r 


and 


If, in theorem A5, |x - a^j is replaced by the general form (A^ - Mij -1 | 

Ini 

3=1 


is replaced by 


I INI 


1 = 1 
1*1 


then an identical proof (ref. 16) will give the following corollary. 

Corollary B5: All eigenvalues of A, lie in the union of the ~ P°^ n ^ 

sets defined by 


( A ii " XI i) ( A jj " ^j) X || =1 I |K ^ 


1=1 

m 


i=i 


A j ,i 


where 


1 g i 
i SN 
i * 3 

In a similar manner, if these substitutions are made in theorem A6, and an identical 
proof is used, the result will be the following corollary. (See ref. 16.) 

Corollary B 5: For any a with 0 g a g 1, each eigenvalue of A satisfies 


_1 / n \ a / n 

hi-^i * im in 


iff-1 


k=r 

,k*3 


k=l 

^k*j 


A kj 


for at least one j, 1 g j g N. 
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C.- Bounds by Vectors and Related Matrices 


This section determines eigenvalue bounds in terms of vectors or in terms of the 
eigenvalues of related matrices. Most of the following proofs depend upon the quadratic 
form of a matrix combined with simple geometric inequalities. 

Bendixson proved the following result for a real matrix A = ( a ij) n ; it was extended 
by Hirsch (ref. 11) to the complex case. 

i(A+A*) i(A+A*) 

Theorem Cl.- If A = a + i/3, and VL and A". are the largest and 

— — iixctA min 

smallest eigenvalues of i(A + A*), then 

i(A+A*) i(A+A*) 

A max = min 

Proof: Let H be an arbitrary Hermitian matrix and U be the unitary trans- 

formation such that U*HU is a diagonal matrix. If the equality 

<x,Hx> = a<x,x> 

is satisfied by a nontrivial x, then 

, H >„ > ,H 
Vax _ _ ^min 


For 


<x,Hx> = <Uy,HUy> = <y,U*HUy > = £ A?yf 


If <x,Hx> = cr<x,x>, then 


n 

ct<x,x> = cr<Uy,Uy > = cx<y,U*Uy > = a ^|y|f 

i=l 
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Therefore 


* H _ 


max 


min 


As was shown in theorem A1 when X = a + i/3 and x is an eigenvector corresponding 

, . A 

to X 


lZ( ai 3 + 5 ji)^ x i = Q!<x ’ x> 


so that 


* 2 (A+A) > >>2 
^max “ a ~ \nin 


1(A+A*) 


Corollary Cl: Since 


A - A 
2i 


is also Hermitian and since 


then 




Aa-a*) £<A-A*) 

X Z1 > 8 ^ X . 

max - P - m xn 


Just as in the proof of theorem Cl, related vectors may be used to define eigenvalues and 
their bounds. 

If Xi is an eigenvalue with a corresponding eigenvector x* for the complex 
matrix A, A?q = Xx^; thus 

<xi,Axj[ > = <Xj,Xxi > = X<Xi,Xj > 
or 

<x.,Ax i > 

Ai=— ^ — 

<x i ,x i > 

In the more general form, this quotient 

q(x) - ±2^ 

<X,X> 

for arbitrary vector x is called the Rayleigh’s quotient. 

If A is Hermitian, there exists a unitary matrix U such that U*AU is a 
diagonal matrix and U*U = I. Then 

<x,Ax> = <Uy,AUy> = <y,U*AUy> = <y,(diag X)y> 
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Also if <x,x> = 1, 


1 = <x,x> = <x,U*Ux> = <Ux,Ux> = <y,y> 

Thus the values assumed by <x,Ax> on <x,x> = 1 are equal to the values assumed 
by <y,(diag Xi)y > on <y,y> = 1. However, 

2 2 2 
<y,(diag Xi)y > = X^ + X 2 y 2 + . . . + X n y n 

so that 

< y,(diag Xj.)y> = ^min < y?y > = ^min 

and 

<y,(diag Xi)y > < A max <y,y > = X max 

Thus 

_ min < y>(^ a S ^i)y > _ min <x,Ax> 
min y <y,y> x <x,x> 

and 

^A _ max < y>(diag Xj)y > _ max <x,Ax> 
max y <y,y > x <x,x> 


Theorem C2.- A relation which gives eigenvalue bounds of the matrix A in terms 
of eigenvalues of the related matrix A*A is 

a ,2 


.A A 
min 


£ xr 


£ X 


A*A 
max 


Proof: Let xj be an eigenvector corresponding to the eigenvalue Xj of A so 

<Axi,Axi> = <XiXi,XjXi> 


that Axj = XjXj and 


or 


<Xi, A*Axi > = Xj< XjXj,x^ > = X^X^ <x^,Xj > 


2 < x* A Ax* > 

Thus |Xj | = — — — , and by the same reasoning as that of theorem Cl 


<x i ,x i > 


. A*A 
'’min 


* 


£ x: 


A*A 

max 


Corollary C2(a): 


x A * A £ IX 

mm 1 • 


A 

min 


max 


£ x: 


A*A 

max 
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Corollary C2(b): If the matrix A is real, then 


A T A 

min 


< 

X A . 

2 

< 

X A 


min 


max 


§ X 


A T A 

max 


The largest eigenvalue cannot only be bounded by considering related vectors but, in 
fact, can be approximated as closely as desired. This result is due to Collatz. (See 
ref. 12.) 


Theorem C3 .- For a matrix A of order k, with k distinct modulus eigenvalues 
and for an arbitrary e > 0, there exists an N > 0 such that 




max 


< e 


(n > N) 


Proof: Let v = ^ J y 1 + /3 2 y 2 + • • • + /3 n y n where y 1} y 2 , . . y n are the 
linearly independent eigenvectors, and let x^y^ so that v = xj + X£ + . • . + x n . 
Assume that the eigenvalues of A are ordered such that 

|Xi| > j X 2 1 ^ ^ | x n | 

Then 


A n z/ = X“ 


x l + 


X2\ n 

*1 


x 2 + . 


hi 

*1 


n 


v n 


As n approaches °°, then approaches 0 for all i. Thus, 


lim 

n— 00 





Several theorems which give eigenvalue bounds in terms of eigenvalues of related 
matrices were shown by Wittmeyer. (See ref. 17.) Some of these theorems are given 
below. 


Theorem C4.- 


Proof: Let 


so that z = ABx. Then 


X (AB)*(AB) < ,A*A X B*B 
max ~ max max 


h = Bx 
z = Ah 
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<y,y> 


where 


so that 


<z,z > = <h,A*Ah> = <y,(diag M)y > = ^ g 

<y,y> = <y,U*Uy > = <Uy,Uy> = <h,h> 

4 a*a\ 1/2 IuI 


A*A 

max 


z § x: 


and 


Thus, 


L max ) 

M 


\z\sUti A T(^ /2 \v 


max/ \ max/ 

Let x be the eigenvector of (AB)*(AB) corresponding to *- K mso [ v , 

(AB)*(AB) Xl = 

Let Zj = ABxj. Then 

| z l| 2 = ( z l> z l) = (ABxj.ABxj) = Jx 1> (AB)’ ll (AB)xjJ = x x | 3 

Thus, let z = Zj so that 

X (AB)*(AB)1 1/2 


max 


= zi ^ Xi I x: 


1| £ | x l|V A maxy i X maxy 


Corollary C4: It follows from theorem C2 and its corollary that 


i AB 

max 


(AB)*(AB) 


max 


) 


1/2 


and also 


i AB 

max 


< f x A*A\ 1/2 / B*B / /2 
- \ max/ \Vax/ 


In a manner similar to that of theorem C4, 


h|sfx B * B ) I/2 |x 

11 min j ' 


that is, 
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M-( x ^) 1/2 M 


so that 


j i > a*a\ 1//2 / , .b*b\ 1 / 2 , I 
i Z I \^min J y^min J I x I 

Let x be such that (AB)*(AB)x^ = so that for Zj = ABxj results i 

, , .. (AB)*(AB), , 

| z l| =X min | x l| 

Theorem C5 .~ Letting z = z^ in the preceding equation yields 

^|[«* (AB f 2 - N * N (€» a ) 1/2 (x ^) 1/2 


and thus proves 


(AB)*(AB) > A*A B*B 
A min “ A min A min 


Corollary C5: In a similar manner the relationships 

1 1/2 


X AB 

> 

X (AB)*(AB)" 

min 


rnin 


and 


* AB 

min 


> , A*A\ 1/2 / B*B\ 1/2 
min j ^min J 


are proved. 

Theorem C6 .- Another theorem which follows from a somewhat different geometric 
consideration if A and B are normal matrices is 


f > (A+B)*(A+B)] 1/2 > ^A*Aj 1/2 + ^B*B\ 1/2 


Lmax 


j 


max ) + r \nax ) 
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Proof: Consider 


X (A+B)*(A+B) = max <x,(A + B)*(A + B)x> 
max x <x,x> 


x 


Vx,A*Ax> <x,B*Bx> <x,B*Ax> <x,A*Bx> 
= maxi — + — + — + — 


<x,x> 


<x,x> 


<x,x> <x,x> 


^ <x,A*Ax> <x,B*Bx> <x,B*Ax> <x,A*Bx> 

% max — 2 r — + max — . — + max — ; — + max 


x <x,x> 


^1 

<x,x> 


<x,x> 


x <x,x> 


_ . A*A ^ ,B*B . xB*A ^ . A*B 
max max max max 


By the corollary to theorem C4 is 


x A*A x B*B B*A x A*B < A*A X B*B 

^max + max + ^max + max ~ max max + 


x bb*a*a\ 

A max max/ 


1/2 


x aa* x b*b\ 

i max max/ 


1/2 


x A*A x B*B 2 
Vax + max + 2 


A*A X B*BY 
max Vax ) 


1/2 


A*A 

Vax 


/2 


+ X; 


B*B 

‘max, 


/ 2 |' 


Thus 


Corollary C6: 


X (A+B)*(A+B) 

A max 


X A+B 

max 


< 


1/2 


2 X 


A*A 

max 


a*aV 

max , 


1/2 



B*B 

Vax 


B*B 

Vax 


1/2 



Theorems C4 to C6 with their respective corollaries may be repeated as corol- 
laries for the special case where A and B are real matrices and the transposed 
conjugate is replaced by the transpose. 


COMPARISON AND COMPUTATION 


From the results of the preceding sections, it is seen that there are many ways to 
compute the bounds for eigenvalues. However, certain theorems give more precise 
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I 


eigenvalue bounds in all cases than 
others. Comparison is now made 
between the inclusion regions of 
eigenvalues for several theorems of 
the section "A.- Bounds by Matrix 
Elements." 


Since 


max 

i 



= n max 




A = 


— Gerschgorin circles 

— Ovals of Cassini 

2 0 0 

1 6 -1 

2 1 4 


A = 2, 5, 5 


Figure L- Comparison of inclusion region for matrix A 
using Gerschgorin circles (theorem A3) and ovals of 
Cassini (theorem A5). 


Corollary A3 gives a smaller region than theorem A1 does in all cases. 

Theorem A5 (ovals of Cassini) give a smaller region than theorem A3 since every 
point of the oval lies in at least one of the two circles which form it. An example of this 
condition is seen in figure 1 and is proven as follows: 


If z is contained in the ovals of Cassini, then 


for some k,Z. If 


and 



j*k 


Thus, every point within the oval lies within at least one of the circles which form it. 
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A = 


1 1 3' 

4 10 2 

3 2 30 



Figure 2.- Regions which can be excluded from containing eigenvalues by 
using the results of theorem A6 for matrix A. 


Theorem A6 gives a smaller inclusion region for all Olai^l than theorem A3. 
The area which can be excluded by using values of a = 0, 1/2, 1 is shown as the shaded 
area in figure 2 for the matrix A whose approximate eigenvalues are 30.55, 10.07, 
and 0.38 (theorem A6). 


If 


z " *4i. 




-a 


then choose the larger of the two summations, 


n n 

I hi ** 

j-i 

]Vi k*i 

Suppose it is 
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then 


Hence, 




-a 


11 


< 





In 

3=1 


Hence, the region of inclusion for eigenvalues for theorem A6 (and hence its corollary) 
is contained within the region of inclusion for eigenvalues for corollary A3. Figure 2 
contains the region of the first two eigenvalues only. (See ref. 14.) The region obtained 
by using theorem A3 corresponds to a= 1. 

Theorem B5 reduces to theorem A3 in the special case where each submatrix is a 
single element of the matrix. For an example of a case in which theorem B5 gives a 
better result than theorem A3, consider the partitioned matrix (ref. 16) 


4 -2 

-2 4 

-1 0 
0 -1 


A 11 

a 12 

-1 0 
0 -1 

4 -2 

-2 4 


J^21 

A 22 


with eigenvalues X = 1, 3, 5, 7 and where the vector norm is taken as 


for 
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Clearly 

|| A 12|| = || A 2i|| - 1 

For ||An|| and ||a 2 2|| consider 

(4 - X)xj - 2x 2 
-2x 1 + (4 - X)x 2 



^1/2 


= inf 
x 


| [(4 - X)xj - 2x 2 ] + \-2 Xl + (4 - X)x 2 ] 

x l 2 + x 2 2 J 


inf 

x 


(4 - xr + 4 - 8(4 - X) 


x l x 2 


- 1 1/2 


x l 2 + x 2 2 


Now 


8 x l x 2 


9x l Xj 2 + Xg2 


X X 

= 0 and ^ 1 2 „ = 0 for Xj = x 2 and x^ = -x 2 - 


9x 2 Xj 2 + x 2 2 


For X < 4, the infimum occurs at 
Xj = x 2> For X > 4, the infimum occurs 
at Xj = -x 2> At Xj = x 2 , the theorem 

requires |x - 2| ^ 1 and at x^ = -x 2 , 

it requires jx - 6| £ 1. 

A comparison between theorem B5 
(whose inclusion region is shaded) and 
theorem A3 is given in figure 3. 



Figure 3.- Comparison of inclusion regions for matrix A by 
using theorem B5 (hatched area) and theorem A3. 
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APPLICATIONS 


Questions relating to the convergence of series and sequences of matrices arise in 
many situations. The eigenvalue bounds of the related matrices can give sufficiency 
conditions for convergence. For example, consider the system of linear equations 
Ax = y where A is a n X n nonsingular matrix of coefficients and x and y are 
n dimensional vectors. (See ref. 18.) Let G be an approximate inverse of A so 
that the approximate solution is z = Gy. It can be shown by induction that for any 
integer k 


x = 


m=0 


is. k 

^ (I - GA) m z + (I - GA) k+1 x = z + ^ 

m=l 


D m z 


D k+1 x 


Denote the error in z by e = x - z and let D = I - GA. Thus 

k 

x - z = e = ^ D m z + D k+ ^x 
m=l 


If 


V D 

max 


< 1, the 


lim D k = 0. 

k-^oo 


Thus 


e 


i 

m=l 


places a bound on the error e . As another example, consider the equation Ax = m 
where A is nonsingular. (See ref. 19.) If x represents the solution and x^. is the 
kth approximation, let = x - x^ anc * ^k = m ” "^k = ^k' Then ^k = ® ^ and 

only if lim y. = 0 and in either case lim x. = x. To determine an iteration on the 
k— °° k— °° 


set of x^ terms, let A = Aj + A 2 with A^ nonsingular. Define the kth iteration by 
x^ = Aj^m - Since A^y^ ^ = -Ag^, for convergence of the iteration, it 


is necessary and sufficient that all eigenvalues of Aj - A 2 be contained in the unit 
circle of the complex plane. 


Iterative schemes may be established to give close approximations to all the eigen- 
values of a matrix. A survey of these techniques together with comparative accuracy 
and computation time is given by White. (See ref. 20.) 
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CONCLUDING REMARKS 


A listing of techniques which determine the eigenvalue bounds of a matrix defined 
over either the real or complex fields is presented. The condition, modulus, or numeri- 
cal value of eigenvalues as a function of the corresponding matrices are listed without 
proofs for several well-known types of matrices. Other known theorems which deter- 
mine the bounds have been proven in detail. These results have been expressed in terms 
of (1) the matrix elements, (2) matrix norms, and (3) vectors and the eigenvalues of 
related matrices. Also extensions of several results have been made to countably infi- 
nite matrices. 

A comparison has been made in terms of the relative size of the areas of eigen- 
value inclusion for several solutions. This comparison has shown that some solutions 
give better results in all cases than other solutions. Examples in terms of eigenvalue 
bounds for particular matrices have been given. 

Langley Research Center, 

National Aeronautics and Space Administration, 

Langley Station, Hampton, Va., September 13, 1967, 

126-62-02-03-23. 
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